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Abstract 



We study a stochastic game where one player tries to find a strategy such that 
the state process reaches a target of controlled-loss-type, no matter which action 
is chosen by the other player. We provide, in a general setup, a relaxed geometric 
dynamic programming principle for this problem and derive, for the case of a 
controlled SDE, the corresponding dynamic programming equation in the sense 
of viscosity solutions. As an example, we consider a problem of partial hedging 
under Knightian uncertainty. 

Keywords Stochastic target; Stochastic game; Geometric dynamic programming principle; Vis- 
cosity solution 
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1 Introduction 

We study a stochastic (semi) game of the following form. Given an initial condition 
(t, z) in time and space, we try to find a strategy u[-] such that the controlled state 
process Z^" v (•) reaches a certain target at the given time T, no matter which control 
v is chosen by the adverse player. The target is specified in terms of expected loss; that 
is, we are given a real- valued ("loss") function I and try to keep the expected loss above 
a given threshold p£l: 



Instead of a game, one may also see this as a target problem under Knightian uncer- 
tainty; then the adverse player has the role of choosing a worst-case scenario. 

Our aim is to describe, for given t, the set A(t) of all pairs (z,p) such that there 
exists a strategy u attaining the target. We provide, in a general abstract framework, a 
geometric dynamic programming principle (GDP) for this set. To this end, p is seen as 
an additional state variable and formulated dynamically via a family {M u } of auxiliary 
martingales with expectation p, indexed by the adverse controls v. Heuristically, the 
GDP then takes the following form: A(t) consists of all (z,p) such that there exist a 
strategy u and a family {M v } satisfying 
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(1.1) 




for all adverse controls v and all stopping times r > t. The precise version of the 
GDP, stated in Theorem l2.ll incorporates several relaxations that allow us to deal with 
various technical problems. In particular, the selection of e-optimal strategics is solved 
by a covering argument which is possible due to a continuity assumption on £ and a 
relaxation in the variable p. The martingale M v is constructed from the semimartingale 
decomposition of the adverse player's value process. 

Our GDP is tailored such that the dynamic programming equation can be derived in 
the viscosity sense. We exemplify this in Theorem l3.4l for the standard setup where the 
state process is determined by a stochastic differential equation (SDE) with coefficients 
controlled by the two players; however, the general GDP applies also in other situations 
such as singular control. The solution of the equation, a partial differential equation 
(PDE) in our example, corresponds to the indicator function of (the complement of) 
the graph of A. In Theorem 13.81 we specialize to a case with a monotonicity condition 
that is particularly suitable for pricing problems in mathematical finance. Finally, in 
order to illustrate various points made throughout the paper, we consider a concrete 
example of pricing an option with partial hedging, according to a loss constraint, in 
a model where the drift and volatility coefficients of the underlying are uncertain. In 
a worst-case analysis, the uncertainty corresponds to an adverse player choosing the 
coefficients; a formula for the corresponding seller's price is given in Theorem 14. II 

Stochastic target (control) problems with almost-sure constraints, corresponding to 
the case where I is an indicator function and v is absent, were introduced in as an 

extension of the classical supcrhedging problem [13] in mathematical finance. Stochastic 
target problems with controlled loss were first studied in [5] and are inspired by the 
quantile hedging problem |12j . The present paper is the first to consider stochastic 
target games. The rigorous treatment of zero-sum stochastic differential games was 
pioneered by 1 1 1 j . where the mentioned selection problem for e-optimal strategies was 
treated by a discretization and a passage to continuous-time limit in the PDEs. Let 
us remark, however, that we have not been able to achieve satisfactory results for our 
problem using such techniques. We have been importantly influenced by [7j, where 
the value functions are defined in terms of essential infima and suprema, and then 
shown to be deterministic. The formulation with an essential infimum (rather than an 
infimum of suitable expectations) in (jl.ip is crucial in our case, mainly because {M v } 
is constructed by a method of non-Markovian control, which raises the fairly delicate 
problem of dealing with one nullset for every adverse control v. 

The remainder of the paper is organized as follows. Section [2] contains the abstract 
setup and GDP. In Section [3] wc specialize to the case of a controlled SDE and derive 
the corresponding PDE, first in the general case and then in the monotone case. The 
problem of hedging under uncertainty is discussed in Section [4] 

2 Geometric dynamic programming principle 

In this section, we obtain our geometric dynamic programming principle (GDP) in an 
abstract framework. Some of our assumptions are simply the conditions we need in the 
proof of the theorem; we will illustrate later how to actually verify them in a typical 
setup. 

2.1 Problem statement 

We fix a time horizon T > and a probability space (0, J 7 , P) equipped with a filtration 
F = (J~t)t£[o,T] satisfying the usual conditions of right-continuity and completeness. We 
shall consider two sets U and V of controls; for the sake of concreteness, we assume 
that each of these sets consists of stochastic processes on (f2, J 7 ), indexed by [0, T], and 
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with values in some sets U and V, respectively. Moreover, let il be a set of mappings 
u : V — > U. Each u £ it is called a strategy and the notation u[u] will be used for the 
control it associates with v G V. In applications, il will be chosen to consist of mappings 
that are non-anticipating; see Section [3] for an example. Furthermore, we are given a 
metric space (Z,dz) and, for each (t,z) G [0,T] x Z and (u, v) G il x V, an adapted 
cadlag process Z^^' u (-) with values in Z satisfying Z^^' v (t) = z. For brevity, we set 

ry\X.V yUH," 

Let I : Z — >• K be a Borel-measurable function satisfying 

E [|£(Z"^(T))|] < oo for all (t,z,u,v) G [0,T] x Z x il x V. (2.1) 
We interpret I as a loss (or "utility" ) function and denote by 

I(t, z, u, v) := E [I (Zf"{T)) \? t ] , (t, z,u,v)e[0,r]xZxllxV 
the expected loss given i/ (for the player choosing u) and by 

J(t, z, u) := essinf I(t, z,U, v), (f, z, u) G [0, T] x Z x il 

the worst-case expected loss. The main object of this paper is the reachability set 

A(i) := {(z,p) G Z x K : there exists u G il such that J(t,z,u) > p P-a.s.}. (2.2) 

These are the initial conditions (z,p) such that starting at time t, the player choosing u 
can attain an expected loss not worse than p, regardless of the adverse player's action v. 
The main aim of this paper is to provide a geometric dynamic programming principle 
for A(t). For the case without adverse player, a corresponding result was obtained 
in [51] for the target problem with almost-sure constraints and in [5] for the problem 
with controlled loss. 

As mentioned above, the dynamic programming for the problem (|2.2[) requires the 
introduction of a suitable set of martingales starting from p G K. This role will be 
played by certain families^ {M 1 ', v G V} of martingales which should be considered as 
additional controls. More precisely, we denote by Ait,p the set of all real-valued (right- 
continuous) martingales M satisfying M(t) = p P-a.s., and we fix a set 9Jlt. p of families 
{M" ,1/ G V} G Mt, p \ further assumptions on 9Jtt, p will be introduced below. Since 
these martingales are not present in the original problem (|2.2[) . we can choose 2Ttt )P to 
our convenience; see also Remark 1 2 . 2 1 below . 

As usual in optimal control, we shall need to concatenate controls and strategies in 
time according to certain events. We use the notation 

i/® T v := vl[o, T ] + v\( T ,T\ 

for the concatenation of two controls v, v G V at a stopping time r. We also introduce 
the set 

\v =(f. r ] v\ '■= { w G O : u s {ui) = D s (uj) for all s G (i,r(cj)]}. 

Analogous notation is used for elements of U. 

In contrast to the setting of control, strategies can be concatenated only at particular 
events and stopping times, as otherwise the resulting strategies would fail to be elements 
of il (in particular, because they may fail to be non-anticipating, see also Section [3]). 
Therefore, we need to formalize the events and stopping times which are admissible 

1 Of course, there is no mathematical difference between families indexed by V, like {M v , v 6 V}, and 
mappings on V, like u. We shall use both notions interchangeably, depending on notational convenience. 
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for this purpose: For each t < T, we consider a set 3* whose elements are families 
{A v , v G V} C Ft of events indexed by V, as well as a set Tt whose elements are families 
{t v ,u G V} C Tt-, where 7t denotes the set of all stopping times with values in [t,T]. 
We assume that Tt contains any deterministic time s G [t, T] (seen as a constant family 
t v = s, v G V). In practice, the sets $t and Tt will not contain all families of events 
and stopping times, respectively; one will impose additional conditions on v i— > A v 
and v i-> t v that are compatible with the conditions defining it. Both sets should be 
seen as auxiliary objects which make it easier (if not possible) to verify the dynamic 
programming conditions below. 

2.2 The geometric dynamic programming principle 

We can now state the conditions for our main result. The first one concerns the con- 
catenation of controls and strategies. 

Assumption (C). The following hold for all t G [0,T]. 

(CI) Fix u , vi,v 2 G V and A G T t - Then v := v a ® t (yxl A + v 2 1a°) S V. 

(C2) Fix (Uj)j>o C it and let {Af,v G V}j>i C St be such that {Af,j > 1} forms a 
partition of Q for each v G V. Then u G il for 



(C3) Let u G il and v G V. Then u[i/ © t ■] G it. 

(C4) Let {A y ,v G V} C T t be a family of events such that A Vl n {Vi =(o,t] ^2} = 
A" 2 n {>i = (0> t] v 2 ] for all w x ,i/ 2 G V. Then {A", 1/ G V} G &. 

(C5) Let {t u , v G V} G T t . Then {t^ 1 < «}n{i/i = (0 , s] v 2 } = K 2 < sjf)^ = (0 , s] z/ 2 } 
P-a.s. for all i/i,i/ 2 G V and s G [i,T]. 

(C6) Let {t v 1 veVje T t . Then, for all t < s 1 < s 2 <T, {{t u G (si, s 2 ]}, v G V} and 
{K g (ai,«a]}, feV} belong to 

The second condition concerns the behavior of the state process. 

Assumption (Z). The following hold for all (t,z,p) G [0,T] x Z x E and s G [i,T]. 

(Zl) Z^ u (s){u) = Z^/{s)(lj) for P-a.e. uj G {uiM = (M] u 2 [i>]}, for all v G V and 
Ui , U 2 G il. 

(Z2) (s)(w) = Z t u f(s)(cj) for P-a.e. u G {1/1 = (0)g] ^2}, for all u G il and v x ,v 2 G V. 

(Z3) M^(s)(w) = M^(s)(w) for P-a.e. w G {i>i = (0)8 ] ^2}, for all {M y , v G V} G 9Jt t , p 
and i/x, v<x G V. 

(Z4) There exists a constant if (t, z)el such that 



The nontrivial assumption here is, of course, |(Z4)| stating that (a version of) the 
random variable esssup ue ^essinfy 6 y E[£(Z"' Z I '(T))|.7 7 {] is deterministic. For the game 
determined by a Brownian SDE as considered in Section [31 this will be true by a result 
of [7], which, in turn, goes back to an idea of (see also [H]). An extension to jump 
diffusions can be found in [5]. 

While the above assumptions are fundamental, the following conditions are of tech- 
nical nature. We shall illustrate later how they can be verified. 




esssupessinfE [t{Z^ {T))\T t ] =K{t,z) P-a.s. 



ueil veV 
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Assumption (I). Let (t, z) G [0, T] x Z, u G il and v £ V. 

(11) There exists an adapted right-continuous process -/V"^ of class (D) such that 

essinf E [l (Z^®""(T)) \T S ] > N*'"(s) P-a.s. for all s G [t, T]. 

(12) There exists an adapted right-continuous process L"'^ such that L"'^(s) 6 L 1 and 

essinf E [£ (Z*® s *' v (T)) \F S ] > L^(s) P-a.s. for all s £ [t, T]. 

Moreover, L"'^ 1 (s)(cj) = L"'^ 2 (s)(w) for P-a.c. u G {y\ =(o. s ] ^2}, for all u G U 
and z/i, v 2 G V. 

Assumption (R). Let (t,z) £ [0,T] x Z. 

(Rl) Fix s G [t,T] and £ > 0. Then there exist a Borel-measurable partition (Bj)j>i 
of Z and a sequence {zj)j>i C Z such that for all u G il, v G V and j >1, 

E[l(Z^(T))\T s ] > I(s,Zj,u,u)-e, 

es_sinfE [^(Z t u ^ P (r))|7" s ] < J(s, z,-,u[i/ ® s •]) + £, J P-a.s. on {Z^(s) £ B 3 }. 

K( s , Zj )-e < K(8,Z%(a)) < K(a,zj)+e 



<5->0 



sup ^(Z^(r + / l ),Z^(r)) > £ ) 



(R2) lim sup P <^ sup d z (Z^(t + h),Z^(f)) > e \ = for all u G 11 and e > 0. 



Our GDP will be stated in terms of the closure 
A(t) := 



(z,p)eZxl: there exist (t n , z n ,p n ) — > (t, z,p) 
such that (z n ,p n ) G A(t„) and t n > t for all n > 1 



and the uniform interior 

A t (f) := {(z,p) £2x1: (t',z',p') £ B L {t,z,p) implies (z',p') G A{t')}, 

where -B t (i, z,p) G [0, T] x Z x R denotes the open ball with center (i, and radius 
l > (with respect to the distance function dz{z, z') + \p — p'\ + \t — The relaxation 
from A to A and A t essentially allows us to reduce to stopping times with countably 
many values in the proof of the GDP and thus to avoid regularity assumptions in the 
time variable. We shall also relax the variable p in the assertion of (GDP2); this is 
inspired by [J] and important for the covering argument in the proof of (GDP2), which, 
in turn, is crucial due to the lack of a measurable selection theorem for strategies. Of 
course, all our relaxations are tailored such that they will not interfere substantially 
with the derivation of the dynamic programming equation; cf . Section [3J 

Theorem 2.1. Fix (t,z,p) £ [0,T] x Z xR and let Assumptions (C), (Z), (I) and (R) 
hold true. 

(GDP1) // (z,p) G A(t), then there exist u G il and {M u , v G V} C M t , P such that 

(Zt£ (r) , M v (t)) G A (t) P-a.s. for all v G V and r £%. 

(GDP2) Let 1 > 0, u G il, {M v , v G V} G Wl t ,p and {t u , v G V} G % be such that 

(Z^{t v ), M v {t»)) G K l {t v ) P-a.s. for all v £ V, 

and suppose that {M v {t v )+ : v G V} and {L 1 ^(t')- : v G V,t' G %} are uniformly 
integrable, where L t is as in [(I2)| Then (z,p- e) G A(t) for all e>0. 
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The proof is stated in Sections 12.31 and 12.41 below. 



Remark 2.2. We shall see in the proof that the family {M v , v G V} C M t , P in (GDP1) 
can actually be chosen to be non-anticipating in the sense of |(Z3)| However, this will 
not be used when (GDP1) is applied to derive the dynamic programming equation. 
Whether {M v ,v G V} is an element of dJlt. p will depend on the definition of the latter 
set; in fact, we did not make any assumption about its richness. In many application, it 
is possible to take dJlt. p to be the set of all non-anticipating families in Mt tP ; however, 
we prefer to leave some freedom for the definition of 9Jlt, P since this may be useful in 
ensuring the uniform integrability required in (GDP2). 

We conclude this section with a version of the GDP for the case Z = R d , where we 
show how to reduce from standard regularity conditions on the state process and the 
loss function to the assumptions |(R1)| and (I) . 

Corollary 2.3. Let Assumptions (C), (Z) artrf |(R2)] hold true. Assume also that I is 
continuous and that there exist constants C > and q > q > and a locally bounded 
function such that 

|*(*)|<C(1 + |*|«), (2.3) 
esssup E[\Z?f(T)\«\F t ] < g(zf P-a.s. and (2.4) 

(u,S)6ilxV 



ess sup E 
(u,p)eiixv 



Z^' v ^{T)-Z^ u f^{T)\\F s <C\Z^{s)-z'\ P-a.s. (2.5) 



for all (t, z) e [0, T] x R d , (s, z') G [t, T] x M d and (u, v) G il x V. 

Let (t, z) G [0, T] x R d and let {r 11 ^, (u, v) G H x V} C Tt be such that the collection 
{Z^" (t u '") , (u, v) G it x V} is uniformly bounded in L°° . 

(GDP1') If(z,p + e) G A(t) for some e > 0, then there exist u £ it and {M" ', veV}c 
M.t, P such that 

(Z 1 ^(t u > v ),M v {t u - v )) G A(t u <") P-a.s. for all ueV. 
(GDP2') If i > 0, u G it and {M u , i/£V}g Wl t , p are such that 

(Z^{t u - v ), M v {t u > v )) G A t (T u,l/ ) P-a.s. /or a/Z i/ G V 
anrf {t u v , i/£V}g T t , i/ien - e) G A(i) /or all e > 0. 



We remark that Corollary 12.31 is usually applied in a setting where t u ' v is the exit 
time of Z t 'z from a given ball, so that the boundcdncss assumption is not restrictive. 
(Some adjustments are needed when the state process admits unbounded jumps; see 
also [IB].) 

2.3 Proof of (GDP1) 

We fix t G [0, T] and (z,p) G A(t) for the remainder of this proof. By the definition (|2.2p 
of A(i), there exists u G il such that 

E [G(v)\F t ] > V P-a.s. for all v G V, where G(» := 1{Z^ Z (T)). (2.6) 

In order to construct the family {M u , v G V} C A^t iP of martingales, we consider 

S v (r) :=essinf E[G(v ® r P)\F r ] , t<r<T. (2.7) 



G 



We shall obtain M v from a Doob-Meyer-type decomposition of S" . This can be seen 
as a generalization with respect to [3], where the necessary martingale was trivially 
constructed by taking the conditional expectation of the terminal reward. 



Step 1: We have S»{r) g L x ( 

v e V. 



and E [S"(r)\ T s ] > S y {s) for all t < s < r < T and 



The integrability of S v (r) follows from (|2.1j) and |(I1)| To see the submartingale 
property, we first show that the family {E[G(z^ ® r P)|J>], v G V} is directed downward. 
Indeed, given v\, i>2 G V, the set 

A := {E [G{v ® r Vi^Fr] < E [G{v ® r ^)|^v]} 

is in J>; therefore, D3 := v (B r (viIa + ^^-A") is an element of V by Assumption | ( C 1 )"| 
Hence, (Z2) yields that 

E[G(y@ r vsilFr] = ^[G{u@ r Vi)l A + G{v@ r v 2 )lAA^r] 

= E[G(z/© r Pi)\T r } 1 A +^[G{v ® r v 2 )\Fr\ 1a= 
= E[G(^© r Pi)|J" r ] AE[G(i/© r ^ 2 )|^>] ■ 

As a result, we can find a sequence {v n )n>i in V such that E[G(z/ ffi r P n )|.7>] decreases 
P-a.s. to S"(r); cf. QH Proposition VI-1-1]. Recalling (gH]) and that S"(r) G L^P), 
monotone convergence yields that 



E[S»(r)\T s ] 



E 



lim E [G(p 1 



= lim E[G(z^ffi r P n )|J" s ] 

n— >-oo 

> cssinfE[G(i/© r P)|J" S ] 

> cssinf E [G(v ffi s v)|J" s ] 

= s», 



where the last inequality follows from the fact that any control v 
can be written in the form v © s (y ffi r v)\ cf. (CI) 



v, where v G V, 



Step 2: There exists a family of cadlag martingales {M v ,v G V} G M.t,p such that 
S v {r) > M v {r) P-a.s. for all r G [t,T] and v G V. 

Fix v G V. By Step 1, S v (-) satisfies the submartingale property Therefore, 
S+(r)(u) := lim S"»H for < r < T and 5+(T) := S"(T) 

u£(r,T]C)Q, u-*-r 

is well defined P-a.s.; moreover, recalling that the filtration E satisfies the usual condi- 
tions, S+ is a (right-continuous) submartingale satisfying S+(r) > S v (r) P-a.s. for all 
r G [t, T] (cf. [EJ Theorem VI.2]). Let iJ C [t, T] be the set of points where the function 
r i-> E[5"(r)] is not right-continuous. Since this function is increasing, H is at most 
countable. (If H happens to be the empty set, then 5+ defines a modification of S u 
and the Doob-Meyer decomposition of S+ yields the result.) Consider the process 

S(r) := S + (r)l H o(r) + S»(r)l H (r), r G [t,T]. 

The arguments (due to E. Lcnglart) in the proof of [5J Theorem 10 of Appendix 1] 
show that S is an optional modification of S u and E[5(t)|J- ct ] > S(a) for all a, r G % 
such that a < r; that is, S is a strong submartingale. Let A" = Nf^ be a right- 
continuous process of class (D) as in |(I1)| then S u {r) > N(r) P-a.s. for all r implies 
that S+(r) > N(r) P-a.s. for all r, and since both S+ and N are right-continuous, this 
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shows that S + > N up to evanescence. Recalling that H is countable, we deduce that 
S > iV up to evanescence, and as 5* is bounded from above by the martingale generated 
by S(T), we conclude that S is of class (D). 

Now the decomposition result of Mertens [T71 Theorem 3] yields that there exist a 
(true) martingale M and a nondecreasing (not necessarily cadlag) predictable process 
C with C(t) = such that 

S = M + C, 

and in view of the usual conditions, M can be chosen to be cadlag. We can now define 
M v := M - M(t) +pon [t,T] and M v {r) := p for r G [0,t), then M" G A4 t , p . Noting 
that M(t) = S(t) = S v (t) >pby flUJ}, we see that A/ 1 " has the required property: 

M"(r) < M(r) < S(r) = S"(r) P-a.s. for all r G [t,T]. 

Step 3: Let r G 7* /iGroe countably many values. Then 

K (r, Z?£(t)) > M v {t) P-a.s. /or a« c£V. 

Fix i/ G V and £ > 0, let M y be as in Step 2, and let (U)i>i be the distinct values 
of r. By Step 2, we have 



M V (U) < essinf E (^"^(T)) | 



-a.s., i > 1. 



Moreover, |(R1)| yields that for each i > 1, we can find a sequence (^3)j>x C 2 and a 
Borcl partition (-Br,)j>i of -E such that 



ess inf E 



(z^f^T)) |JT ti ] ( W ) < J^,^., u ^© ti •])(«)+£ 

for P-a.c. w G Cy := {^"(ij) G By}. 



Since [(C3"J| and the definition of K in |(Z4)| yield that J(U, Zij,u[v®n •]) < K(U,Zij)i we 
conclude by |(Rl)| that 

M"(ii)(w) < Zij) + e < K(U, Z?£ (U)(u))) + 2e for P-a.c. u G C tJ . 

Let Aj := {t = i;} G T T . Then (Ai n C,j)jj>i forms a partition of and the above 
shows that 

M» - 2e < X] K(U, Z^{U))l Air , Cij = K(t, Z^(t)) P-a.s. 
As e > was arbitrary, the claim follows. 

Step 4 : We can now prove (GDP1). Given r G 7t, pick a sequence (r„)„>i C 7t such 
that each t„ has countably many values and r„ J, r P-a.s. In view of the last statement 
of Lemma 12.41 below, Step 3 implies that 

(2*f(T„),M"(r„) - G A(r„) P-a.s. for all n > 1. 

However, using that Z"' z " and Af " are cadlag, we have 

(r„, Z t u ^(r„), M u ( Tn ) - n- 1 ) -> (r, Z£'»{t), M"(t)) P-a.s. as n -> oo, 

so that, by the definition of A, we deduce that (Z?£(t), M v (t)) G A(t) P-a.s. □ 

Lemma 2.4. Le£ Assumptions [(C2)j |(C4)[ |(Z1)| cmri |(Z4)| feo^d £rue. for eac/i e > 0, 
i/jere exists a mapping /i E : [0, T] x Z — » il smc/i i/iai 

J (i, z, //(£, z)) > z) - e P-a.s. for all (t, z) G [0, T] x Z. 

in particular, if (t, z,p) G [0, T] x 2 x M., then K(t, z) > p implies (z,p) G A(i). 
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Proof. Since K(t, z) was defined in |(Z4)| as the essential supremum of J(t, z, u) over u, 
there exists a sequence (u fc (t, z))k>i C ii such that 



sup J (t, z, u k (t, z)) = K{t, z) P-a. 
fe>i 

Set A° z := and define inductively the J^-measurable sets 

fc-i 

At := {</ (t, «, u fe (t, z)) > K(t, z)-e}\\jA 

3=0 



(2. 



3 

t.z i 



k > 1. 



By (|2.8p , the family {Aj z , /c > 1} forms a partition of fl. Clearly, each A^ z (seen as a 
constant family) satisfies the requirement of |(C4)| since it does not depend on v, and 
therefore belongs to $t- Hence, after fixing some Uo G ii, |(C2)| implies that 

/i e (i,z) :=u ® t ^u fe (i,z)l A ^ Gil, 



fc>l 



while pi)] ensures that 



ess inf E 



[i(< {t '*>'"(T) 



ess inf E 



k>l 

ss inf Vlf- 
i/ev ^— ' 1 



(T) )1 A * l-Ft 



f 2. 



u*(t,z),i/ 



CO |Ji 



fc>i 



where the last step used that A^ z is J-t-measurablc. Since 
E f 



^ (^*'*)'"(T)) > J(M,u fc (M)) 
by the definition of </, it follows by the definition of {A^ z , k > 1} that 
J (f, z, //(i, z)) > ]T J (i, z, u fc (i, z)) 1 A * a > K(f, z) 



fc>i 



as required. 



□ 



Remark 2.5. Let us mention that the GDP could also be formulated using families 
of submartingales {S v ,v G V} rather than martingales. Namely, in (GDP1), these 
would be the processes defined by (|2.7[) . However, such a formulation would not be 
advantageous for applications as in Section [31 because we would then need an additional 
control process to describe the (possibly very irregular) finite variation part of S v . 
The fact that the martingales {M", v G V} are actually sufficient to obtain a useful 
GDP can be explained heuristically as follows: the relevant situation for the dynamic 
programming equation corresponds to the adverse player choosing an (almost) optimal 
control v, and then the value process S v will be (almost) a martingale. 



2.4 Proof of (GDP2) 

In the sequel, we fix (t, z,p) E [0, T] x Z x R and let i > 0, u e il, {M v , veV}e Tt t , p , 
[t v , v G V} G It and V^ v z be as in (GDP2). We shall use the dyadic discretization for 
the stopping times t v '; that is, given n> 1, we set 

<= E tf+^W^+jCOi where i" = i2~ n T for < i < 2". 

0<i<2"-l 
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We shall first state the proof under the additional assumption that 

M v {-) = M v {- A t v ) for all v £ V. 
Step 1: Fix e > and n > 1. There exists u e n G II swc/i i/iai 



(2.9) 



E 



£ (^'"(T)) > A" «, Z t u ^«)) - e P-a.s. /or aU v G V. 



We fix £ > and n > 1. It follows from | (Rl ) | and | (C2) | that , for each i < 2", we 
can find a Borcl partition (-Bij)j>i of and a sequence (Zy)j>i C 2 such that, for all 
ueU and v 6 V, 



E 



£(X/ ?U,!y (T)) |J- t? ] (w) > I(t?, Zij ,u® t? u,v)(uj)-e and (2.10) 

> K{t?,Z% (%)(«,)) -e (2.11) 
for P-a.c. ,£C-= {Z£' z u (t?) £ By}. 

Let /j e be as in Lemma l2~4l ufj := /-t e (i", and := C,^ D {t,^ = t"}, and consider 
the mapping 

v i ^ u £ „ [i/] := u[i/] © T » ^ 4 M 1 A » . 

3>1, i<2™ 



Note that (Z2) 



it follows from 



and 



(C6) 



(C4)1 imply that {C^,v G V}j>i C fo» for each i < 2". Similarly, 



and the dehnition of that the families {{r^ = t"},^ £ V} and 
{{r^ = tf} c ,v £ V} belong to S"t«. Therefore, an induction (over i) based on |(C2)| 
yields that G U. Using successively (|2.10[) , [(Zl)| the definition of J, Lemma 12"^! and 
(f2~TT1) . we deduce that for P-a.c. u G A^., 

E [| (^g'"(T)) |JyJ (w) > / (*?> 4^) H - e 

= Ji«H,Z^«)H)-3 £ . 

As e > was arbitrary and UijA^ = P-a.s., this proves the claim. 
Step 2: Fix e > and n > 1. For ^GV, we /law 



E 



£ U"r (T) |^r» (w) > M"«)M - e /or" P-a.e. w £ 



where 



Indeed, since (Z"'/(t i/ ), M^t")) £ A^r") P-a.s., the definition of A t entails that 
{Z^{t^),M"{t^)) £ A«) for P-a.e. u £ ££. This, in turn, means that 

K «H, ^«)(u,)) > M"«)(w) for P-a.c. w £ ££. 

Now the claim follows from Step 1. (In all this, we actually have M v (t^) = M v {t v ) 
by (|2.9[) . a fact we do not use here.) 



Step 3: Let V := be the process from \(T2)\ The 

'(i"«)-M"«))-l (B{;)£ 



>p-e- supE 
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Indeed, it follows from Step 2 and |(I2)| that 

E[£ (Z</{T)) \T t _ 
> E[M"«)l B ,|J- 4 ]-^ 



3 



t(z<' v {T)) \T K 



HE-) 



> E [M v {r v n )\T t ] - E [M"«)1 (BK) .|^] - e + E [L"«)l (BS) .|.F t ] 
= p - e + E - M"«)) • 

By the definitions of A and J, we deduce that 

> J(t,z,<) 

> p - e + ess tof E - M"«)) |.F t ] . 
Since A' is deterministic, we can take expectations on both sides to obtain that 



K{t,z) >p-e + E 



ess infE[r ly |J" t l 



where Y" := - M"«)) 1 {E ^ 



The family {E [y|J" t ] , v G V} is directed downward; to see this, use (CI) (Z2) (Z3) 



|(C5)| and the last statement in |(I2)| and argue as in Step 1 of the proof of (GDPl) in 
Section l2~51 It then follows that we can find a sequence {vk)k>i C V such that E [Y Vk \Ft] 
decreases P-a.s. to essinf^gy E [y"|J-t], cf. [HO Proposition VI-1-1], so that the claim 
follows by monotone convergence. 



Step 4 : We have 



lim sup E 



(L"(T^-M"(r^)-l (E ,y 







Indeed, since M v (t" l ) = M u (t u ) by (|2.9p . the uniform intcgrability assumptions 
in Theorem I27T1 yield that {(£"(t£) — M"(t£))~ : n > l,v G V} is again uniformly 
integrable. Therefore, it suffices to prove that sup^gy P {{E£) c } — > 0. To see this, note 
that for n large enough, we have — t v \ < 2~ n T < l/2 and hence 

P{(K) C } <v{d z (z^K),z^{r»)) > t/2} , 

where we have used that M u (t%) = M v {t v ). Using once more that |< - t v \ < 2~"T, 
the claim then follows from |(R2)| 

Step 5: The additional assumption (|2.9[) entails no loss of generality. 

Indeed, let M v be the stopped martingale M v {- A r"). Then {M",i/ eV}c 7W t , p . 
Moreover, since {M y ,i/ eV}£ Tlt, P and {r",^ G V} 6 T t , w c sec from p3)] and [(C5)] 
that {M y , v G V} again satisfies the property stated in |(Z3)| Finally, we have that the 
set {AI v {t v ) + : v G V} is uniformly integrable like {M v (t v ) + : v G V}, since these 
sets coincide. Hence, \M V ,p G V} satisfies all properties required in (GDP2), and of 
course also (|2.9j) . To be precise, it is not necessarily the case that {M v , i/£V}e 
in fact, we have made no assumption whatsoever about the richness of 9Jtt. p . However, 
the previous properties are all we have used in this proof and hence, we may indeed 
replace M v by M v for the purpose of proving (GDP2). 

We can now conclude the proof of (GDP2): in view of Step 4, Step 3 yields that 
K(t, z) > p — e, which by Lemma implies the assertion that (z,p — e) G A(t). □ 



11 



2.5 Proof of Corollary I2~51 



are 



Step 1: Assume that I is bounded and Lipschitz continuous. Then (I) and |(R1)] 
satisfied. 

Assumption (I) is trivially satisfied; we prove that (|2.5[) implies Assumption |(R1 jj 
Let t < s < T and (u, v) 6 it x V. Let c be the Lipschitz constant of I. By (|2.5|) . we 
have 



i(z^{T))-l(z^,{T))\ 



< cl 



t,z 
u . y 



(T)-»(T) \T S 



(2.12) 



for all z,z' 6 M d . Let (Bj)i>i be 

any Borel partition of K d such that the diameter of 
Bj is less than e/(cC), and let z,- G -Bj for each j > 1. Then 



^(z t Y(T))-^(z.^.(T))| 



< e on C - 



which implies the first property in |(R1)| In particular, let v € V, then using (Cl)| we 
have 



3 



I ( z s u ~ 



<e on C, 



Since C*' v ®" v = C"'" by |(Z2)[ we may take the essential infimum over veVto conclude 
that 

es_s_inf E [l {Z^®° V (T)) \T S ] < J{s, Zj ,u[v ffi s •]) + e on C l - U , 

which is the second property in |(R1)| Finally, the last property in |(R1)| is a direct 
consequence of (|2.12p applied with t = s. 

Step 2: We now prove the corollary under the additional assumption that \£{z)\ < C; we 
shall reduce to the Lipschitz case by inf-convolution. Indeed, if we define the functions 
4 by 

40) = inf {i(z') + k\z' - z\}, k > 1, 

then 4 is Lipschitz continuous with Lipschitz constant k, |4| < C, and (lk)k>i con- 
verges pointwise to t. Since £ is continuous and the sequence (4)fc>i is monotone 
increasing, the convergence is uniform on compact sets by Dini's lemma. That is, for 
all n > 1, 

sup \i k {z)-£{z)\<e n k , (2.13) 

z£R d , \z\<n 

where (e^)k>i is a sequence of numbers such that limfe-j-oo = 0. Moreover, (|2.4p 
combined with Chebyshev's inequality implies that 



esssup ¥{\Zl l -:(T)\ > n\T t ) < {g{z)/nf. 
(u,y)euxv 



(2.14) 



Combining (|2.13p and (|2.14[) and using the fact that 4 — I is bounded by 2C then leads 
to 

esssup iE[\l k (Z?;:{T))-i(Z? ; :(T))\ | ? t ] < e£ + 2C{ e (z)/nf. (2.15) 

(u,i/)GUxV 

Let O be a bounded subset of R d , let -q > 0, and let 

I k {t, z,u, u)=E [4 {Z^{T)) . (2.16) 

Then we can choose an integer Uq such that 2C(g(z)/nQY < ij/2 for all z <G O and 
another integer such that e fe ° < 77 / 2 . Under these conditions, (|2.15[) applied to 
n = h'q yields that 

esssup I k i (t,z,u,u) -I(t,z,u,u) < rj for (i, z) e [0, T] x O. (2.17) 
(u^)eiixv 
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In the sequel, we fix (t, z,p) £ [0, T] x M. d x R and a bounded set O cM. d containing z, 
and define Jk^i ^-fcji ^fc^,t an d A/^ in terms of £ k n ) instead of I. 

We now prove (GDP1'). To this end, suppose that (z,p + 2r?) £ A(rj). Then (j2~TT)) 
implies that (z,p + rf) £ A fc ^(t). In view of Step 1, we may apply (GDP1) with the loss 
function £ k ^ to obtain u £ il and {M", v £ V} C -Mt iP such that 

(Z^(t),M"(t) + 77) £ A fcS (r) P-a.s. for all v £ V and r £ 77- 

Using once more (|2.17[) . we deduce that 

{Z^{t),M v (t)) £ A(r) P-a.s. for all ^ £ V and r £ 7^ such that Z"^(r) £ O. 

Recalling that {-Z^ (t 11 ' 1 ') ,(u,is) £ il x V} is uniformly bounded and enlarging O if 
necessary, we deduce that (GDP1') holds for £. (The last two arguments are superfluous 
as I > £ k ^ already implies A k ^ (r) C A(r); however, we would like to refer to this proof 
in a similar situation below where there is no monotonicity.) 

It remains to prove (GDP2'). To this end, let i > 0, u £ il, {M v , v £ V} £ M t , p and 
{t v , v £ V} £ % be such that 

{Z^(t v ),M v {t v )) £ A 2l (t») P-a.s. for all u £ V. 

For 77 < t/2, we then have 

(Z^(t u ),M"{t v ) + 2rj) £ A t (r") P-a.s. for all v £ V. (2.18) 

Let M v := il/" + 77. Since {Z t u f (r") , f £ V} is uniformly bounded in L°°, we may 
assume, by enlarging O if necessary, that i3 t (Z t u L! y (r I/ )) C O P-a.s. for all v £ V. Then, 
(j2T7f and ([2T8)l imply that 

(^"(t"), M v {t v )) £ Afcj.^r") P-a.s. for all v £ V. 

Moreover, as £ < C, (|2TTg|) implies that M v (t v ) < C; in particular, {M ly (r l/ )+, 1/ £ V} 
is uniformly integrable. Furthermore, as I > — C, we can take L"'J := — C for (12) In 
view of Step 1, (GDP2) applied with the loss function £ k ^ then yields that 

(z,p + r)-e) £ Afcj^t) foralleX). (2.19) 

To be precise, this conclusion would require that {M v \v £ V} £ Wlt, p + V , which is not 
necessarily the case under our assumptions. However, since {M u , v £ V} £ 9Hf jP , it is 
clear that {M u , v £ V} satisfies the property stated in |(Z3)| so that, as in Step 5 of the 
proof of (GDP2), there is no loss of generality in assuming that {M v , v £ V} £ 9Jlt :P + v - 
We conclude by noting that (|2.17p and (|2.19|) imply that (z,p- e) £ A(i) for all s > 0. 

Step 3: We turn to the general case. For k > 1, we now define 4 := (^ A fc) V (— k), 
while Jfe is again defined as in (|2.16[) . We also set 

n k = max {m > : B m (0) C {£ = 4}} A fc 

and note that the continuity of £ guarantees that linifc_ ) . 00 n k = 00. Given a bounded 
set O C R d and 77 > 0, we claim that 



ess sup 
(u,i/)eiixv 



4 s (t,z,u,^) - J(i, z, u, < 77 for all (t, z) £ [0, T] x O (2.20) 



13 



for any large enough integer fc^. Indeed, let (u, v) Eilx V; then 
\I k (t,z,u,v)-I(t,z,u,v)\ < E[\l-t k \(Z%(T))\F t ] 



= E 
< E 
C*E 



\i - 4| (Zl\'!?(T)) l| Z .,^ (T) ^ {i , =£fc} ||J : ' t 
l £ (^T( T ))l 1 {|^(r)|>„ fe } 



{1+\Z?'»(T)\ 



1 {\Z^(T)\>n k }\ :F t 



by (|2.3[) . We may assume that q > 0, as otherwise we are in the setting of Step 2. Pick 
5 > such that q(l + 5) = q. Then Holder's inequality and (|2.4[) yield that 



E 



< 



(^X | 9 1 {|z;',-(T)i>« fc }l jr t 



(Z? : : (T)) | * | T t ) ™ P { | Z»-; (T) I > n fc | F t } T 



< P{z)^{p{z)/n k )^+ 

Since p is locally bounded and lim^oo n k = oo, the claim (j2.20j) follows. We can 
then obtain (GDP1') and (GDP2') by reducing to the result of Step 2, using the same 
arguments as in the proof of Step 2. □ 



3 The PDE in the case of a controlled SDE 

In this section, we illustrate how our GDP can be used to derive a dynamic programming 
equation and how its assumptions can be verified in a typical setup. To this end, we focus 
on the case where the state process is determined by a stochastic differential equation 
with controlled coefficients; however, other examples could be treated similarly. 



3.1 Setup 

Let Q = C([0,T];R d ) be the canonical space of continuous paths equipped with the 
Wiener measure P, let E = (J- t )t<T be the P-augmentation of the filtration generated 
by the coordinate-mapping process W, and let T = Tt> We define V, the set of adverse 
controls, to be the set of all progressively measurable processes with values in a compact 
subset V of M. d . Similarly, U is the set of all progressively measurable processes with 
values in a compact U C M. d . Finally, the set of strategics it consists of all mappings 
u : V — > U which are non-anticipating in the sense that 

{v\ =(o,s] ^2} C {u[^i] =(o, s ] u[^ 2 ]} for all v u v 2 G V and s <T. 

Given (t, z) £ [0, T] x M. d and (u, v) <G it x V, we let Z^ be the unique strong solution 
of the controlled SDE 

Z{s) = z + J fj l {Z(r),u[v} r ,v r )dr + J a{Z(r),u[u} r , v r ) dW r , s€[t,T], (3.1) 

where the coefficients 

H : M. d x U x V -> R d , a : R d x U x V -> R dxd 

are assumed to be jointly continuous in all three variables, Lipschitz continuous with 
linear growth in the first variable, uniformly in the two last ones, and Lipschitz contin- 
uous in the second variable, locally uniformly in the two other ones. Throughout this 
section, we assume that I : M. d R is a continuous function of polynomial growth; i.e., 
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holds true for some constants C and q. Since Z t ' z (T) has moments of all orders, 
this implies that the finiteness condition (|2.1j) is satisfied. 

In view of the martingale representation theorem, we can identify the set Ait.p of 
martingales with the set A of all progressively measurable e?-dimcnsional processes a 
such that / adW is a (true) martingale. Indeed, we have Mt, P = {P" p , a G -4}, where 

P« p (.)=p + j a s dW s . 

We shall denote by 21 the set of all mappings o[-]: V M> A such that 

{ V X =(o,s] v-i) C {a[ui] =( ,s] <Ay 2 ]} for all v x , ^ 2 G V and s < T. 

The set of all families {P"^', v G V} with a G 21 then forms the set 9Jtt iP , for any given 
G [0, T] x R. Furthermore, %t consists of all families jr" ,v G V} C 7t such that, 
for some (z,p) G K d x K, (u, a) G It x 21 and some Borel set O C [0, T] x R d x R, 

t v is the first exit time of (-, Zf£, Ptjpj from O, for all v G V. 

(This includes the deterministic times s G [i, T] by the choice O = [0, s] x R d x K.) 
Finally, # t consists of all families {^4", c £ V} C Ji such that 

^l" 1 n {i/i = (0 ,f] j/ 2 } = A" 2 n {i/i = (0)t ] v 2 } for all ^,i/ 2 G V. 

Proposition 3.1. The conditions of Corollarv \2.3\ are satisfied in the present setup. 



Proof. The above definitions readily yield that Assumptions (C) and (Z1)| - |(Z3)| are 
satisfied. Moreover, Assumption |(Z4)j can be verified exactly as in [71 Proposition 3.3]. 
Fix any q > q V 2; then (|2.4p can be obtained as follows. Let (u, v) G iX x V and A e J f 
be arbitrary. Using the Burkholdcr-Davis-Gundy inequalities, the boundedncss of t/ 
and V, and the assumptions on /i and er, we obtain that 



E 



t<S<T 



< cE 



1a+ sup ^"^(s)] 9 1^^ 

Jt t<s<r 



where c is a universal constant and r is any stopping time such that Z^'^{- A r) is 
bounded. Applying Gronwall's inequality and letting r — > T, we deduce that 



E 



|^(T)| 9 1 A 



< E 



t<u<T 



< 



cE [(l + 



Since 4e J t was arbitrary, this implies (|2.4p . To verify the condition (|2.5|l . we note 
that the flow property yields 



E 



(T) - Z^f-(T) 



= E 



Z 



;K*( s r ' s ' z ' [ ' 



1a 



and estimate the right-hand side with the above arguments. Finally, the same arguments 
can be used to verify |(R2)| □ 

Remark 3.2. We emphasize that our definition of a strategy u G il does not include 
regularity assumptions on the mapping v i— > u[v]. This is in contrast to [2], where a 
continuity condition is imposed, enabling the authors to deal with the selection problem 
for strategies in the context of a stochastic differential game and use the traditional 
formulation of the value functions in terms of infima (not essential infima) and suprema. 
Let us mention, however, that such regularity assumptions may preclude existence of 
optimal strategics in concrete examples (sec also Remark [ 
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3.2 PDE for the reachability set A 

In this section, we show how the PDE for the reachability set A from (|2.2I) can be 
deduced from the geometric dynamic programming principle of Corollary 12.31 This 
equation is stated in terms of the indicator function of the complement of the graph 
of A, 

<+ n \ 1 1 < ^ f° if (^) eA (*) 
X{t,z,p) := 1 - l A{t) {z,p) 



1 otherwise, 



and its lower semicontinuous envelope 



X*(t,z,p):= liminf x(t',z',p'). 

(*' ,v ,p')->(t,z,p) 

Corresponding results for the case without adverse player have been obtain in [31 [55] ; 
we extend their arguments to account for the presence of v and the fact that we only 
have a relaxed GDP. We begin by rephrasing Corollary (53] in terms of X- 



Lemma 3.3. Fix {t,z,p) £ [0,T] x R d x R and let O C [0, T] x R d x ffi be a bounded 
open set containing (t,z,p). 

(GDP1 X ) Assume that x{t, z,p + e) = for some e > 0. Then there exist u G it and 
{a v , v £ V} C A such that 

X, (r^jVa^V)) = p - a - s - V a " " G V, 
where t v denotes the first exit time of (•, , P t °L ) from O. 

(GDP2 X ) Let ip be a continuous function such that ip > x and let (u, a) £ it x 21 and 
r\ > be such that 

ip (r v , Z^{t v ), Pffirn) <1~V P-a.*. for all v £ V, (3.2) 

where r v denotes the first exit time of (•, Z^'* ', P"!"') /rom O. TTien z,p — e) = 
/or a// e > 0. 

Proof. After observing that + e) € A(t) if and only if x(t, z,p + e) =0 and that 
G A(t) implies = 0, (GDP1 X ) follows from Corollary 12.31 whose condi- 

tions are satisfied by Proposition 13.11 We now prove (GDP2 X ). Since ip is continuous 
and dO is compact, we can find i > such that 

ip < 1 on a l- neighborhood of dO D {ip < 1 — rj}. 
As x < <P, it follows that (|3.2[) implies 

(^"(Oj M^t")) G K l (t u ) P-a.s. for all i/ G V. 

Now Corollary [2~31 yields that (z,p — e) £ A(t); i.e., x(t, z,p — e) =0. □ 

Given a suitably differentiable function ip = ip(t,z,p) on [0,T] x we shall 

denote by dtip its derivative with respect to t and by Dip and £> 2 <p the Jacobian and 
the Hessian matrix with respect to (z,p), respectively. Given u £ U, a £ M. d and v £ V, 
we can then define the Dynkin operator 

tfzl'p)? := d t¥ + P(z,P)(-,u,v) T Dip + -Tr o- {z , P) o-J ZP] (-,u,a,v)D 2 ip 



with coefficients 



Hz,p) := ( o ) ' a iZ-P)i^ a ^) := ( a ) 
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To introduce the associated relaxed Hamiltonians, we first define the relaxed kernel 
Af £ (z,q,v) = j(u,a) G U x R d : aj zp ^(z,u, a,v)q < ej , e>0 

for z G M. d , q G and 06 V, as well as the set Nn p (z, q) of all continuous functions 

(u, a) : R d x R d+1 xV xR d , (z' , q', v') h-> (u, a)(z', g', u') 

that are locally Lipschitz continuous in (z',q'), uniformly in v' , and satisfy 

(u, a) G Ao on B x V, for some neighborhood B of (z, q). 

The local Lipschitz continuity will be used to ensure the local wellposedness of the SDE 
for a Markovian strategy defined via (it, a). Setting 

F(@, u,a,v) := j-^( ZiP )(z,u,u) T g - ^Tr o- {z ^ P) a^ ZP) (z 7 u,a,v)A 

for 9 = (z, q, A) G M d x R d+1 x S d+1 and (u, a,v) eU xR d xV, we can then define the 
relaxed Hamiltonians 

H*(Q) := inf limsup sup F(&,u,a,v), (3.3) 
" eV e\,o,e'->e («,o)GJV B (e',«) 

ff*(0) := sup inf F(e,u(9,u),a(e,u),u). (3.4) 

(a,a)eJVi <P (e) ueV 

(In (|3.4p . it is not necessary to take the relaxation 9' —> because inf v£ y F is already 
lower semicontinuous.) The question whether H* = is postponed to the monotone 
setting of the next section; see Remark 13.91 

We are now in the position to derive the PDE for x; hi the following, we write 
H*ip(t, z,p) for H*(z, Dip(t, z,p), D 2 (p(t, z,p)), and similarly for if*. 

Theorem 3.4. The function x* is a viscosity super solution on [0, T) x M. d+1 of 

(—d t + H*)ip > 0. 
The function x* is a viscosity subsolution on [0, T) x K rf+1 of 

(-dt + H„)<p < 0. 

Proof. Step 1: x* * s a viscosity super solution. 

Let {t 0l z ,p ) G [0,T) xf'xl and let ip be a smooth function such that 

(strict) min (x* — <p) = (x* - ¥>) (*oi ^o,Po) = 0. (3.5) 

[0,T)xR d xK 

We suppose that 

{-dt + H*)<p{t ,z ,p ) < -2n < (3.6) 

for some n > and work towards a contradiction. Using the continuity of [i and a and 
the definition of the upper-scmicontinuous operator H*, we can find v G V and e > 
such that 

-£fg$tp(t,z,p) < -v 
for all (it, a) G A/" E (z, D(p(t, z,p), v a ) and (t, z,p) G B e , 
where B e := B e (t a , z ,p ) denotes the open ball of radius e around (t 0l z 0l p ). Let 



dB e := {t + e} x B e (z ,p ) U [t ,t + e) x dB £ (z ,p ) 
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denote the parabolic boundary of B e and set 

C := min(x* - <p). 

In view of (|3.5D . we have ( > 0. 

Next, we claim that there exists a sequence (t n , z n ,p n , e n )„>i C B e x (0, 1) such 
that 

(in,z„,p n ,e„) -> (i o ,z o ,p o ,0) and x(t n , z ni p n + e„) = for all n > 1. (3.8) 

In view of x <= {0, 1}, it suffices to show that 

X*(to, z ,p o ) = 0. (3.9) 

Suppose that x*(£ ,z ,p ) > 0, then the lower semicontinuity of x* yields that x* > 
and therefore x = 1 on a neighborhood of (t a , z ,p ), which implies that ip has a strict 
local maximum in (t 0l z ,p ) and thus 

O) Po 

) < 0, Dtp(t , z ,p ) = 0, D 2 ip(t 0l z ,p ) < 0. 

This clearly contradicts (|3.7[) . and so the claim follows. 

For any n > 1, the equality in (|3.8[) and (GDP1 X ) of Lemma T3.3I yield u n G ii and 
{a"-", i/ G V} C .A such that 

X*(t^r n: Z n {tAT n ),P n (tAT n )) = 0, i>t„, (3.10) 

where 

(Z"( S ),P"( S )) := (ftW.CW) 

and 

r„ := inf {s > i„ : (s, Z"(s), P"(s)) g . 

(In the above, v Q G is viewed as a constant element of V.) By (|3.10p . (|3.5[) and the 
definitions of £ and r„ , 

-VJ(-, Z n , P n )(t A Tn ) = (x* - <p)(; Z n ,P n )(t A r n ) > Cl{t>r„} > 0. 
Applying Ito's formula to —<p{-, Z n ,P n ), we deduce that 

S n (t) := S„(0) + jf <5 n (r) dr + jf E n (r) dW r > -Cl{t<r„}, (3.11) 

where 

<S„(0) := -C - <p{t n ,Z n ,Pn), 

Sn(r) := -^""'Xr.mn)), 
E n (r) := -^(r,Z"(r),P"(r)) T f T (Z! p ) (Z"(r),<H,<^,« ). 

Define the set 

A n := [t n ,T n ] n {<5„ > -t]}; 
then p.7p and the definition of Af £ imply that 

|S„|>£ onA n . (3.12) 

Lemma 3.5. After diminishing e > if necessary, the stochastic exponential 

is well-defined and a true martingale for all n > 1. 
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This lemma is proved below; it fills a gap in the previous literature. Admitting its 
result for the moment, integration by parts yields 

ftf\T n 

{E n S n ){tAr n ) = S n (0)+ E n 5 n l A cdr 



tAT " / 8 \ 

E n f E„ - S n -^jZ n lA n J dW. 

As E n > 0, it then follows from the definition of A n that E n 5 n lA^ < and so E n S n 
is a local supermartingale; in fact, it is a true supermartingale since it is bounded from 
below by the martingale —C,E n . In view of (|3.11[) . we deduce that 

-C - <p{t n ,z n ,p n ) = (E n S n )(t n ) > E [(E n S n ){r n )] > -(E [l {r „ <Tti} E„(r„)] = 0, 

which yields a contradiction due to ( > and the fact that, by Q3.9p . 

<p{t n ,z n ,p n ) -> cp(t ,z ,p ) = x*(t ,z ,p ) = 0. 

Step 2: \* * s a viscosity subsolution. 

Let (t ,z ,p ) e [0,T) x R d x R and let y be a smooth function such that 

max (x* - ip) = (x* ~ (p)(t ,z ,p ) = 0. 

[O.TJxR^xR 

In order to prove that (— dt + H«)tp(t , z 0l p ) < 0, we assume for contradiction that 

{-dt+H*)tp{t o ,z o ,p o )>0. (3.13) 

An argument analogous to the proof of (|3.9I) shows that X* (to, z ,p ) = 1- Consider a 
sequence (t n , z n ,p n ,e n ) n >i in [0,T) x l d x R x (0, 1) such that 

{t n , z ni p n - £„,£„) -» (t o ,z o ,p o ,0) and x(tn,z n ,p n - £„) -)• X*(*o, Zo,Po) = I- 

Since % takes values in {0, 1}, we must have 

X(tn,Zn,Pn - £n) = 1 (3-14) 

for all n large enough. Set 

ip(t, z,p) := tp(t, z,p) + \t- t Q \ 2 + \z- z \ 4 + \p- p | 4 . 

Then the inequality (|3.13[) and the definition of H„ imply that we can find (u, a) in 

Nup{-, D(p){t , z 0l p ) such that 

inf (-C$%' DM ' v <p) > on B e := B € (t , z Q , Po ) , (3.15) 



for some e > 0. By the definition of N^ip, after possibly changing e > 0, we have 

{u,a)(-,Dip, •) e Af (-,Dip,-) onB e xV. (3.16) 

Moreover, we have 

^ ></? + ?/ on5B s (3.17) 

for some r\ > 0. Since (p{t n , z n ,p n ) — >■ ip{t Ql z 0l p ) = x* (t , z 0l p ) = 1. we can find n 
such that 

<f{tn,Z n ,Pn) < l+lj/2 (3.18) 
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and such that (|3.14p is satisfied. We fix this n for the remainder of the proof. 

For brevity, we write (u,a)(t, z,p,v) for (u,a)(z, Dip(t, z,p),v) in the sequel. Ex- 
ploiting the definition of N^p, we can then define the mapping (u, &)[•] : V — s- U x A 
implicitly via 

(a, o)M = (fi, a) (•, p^l , «/) i [t „, T , ]5 

where 

r V :=inf{r>t„: (r, sg^r), Pgjr)) £ B e ) . 

We observe that u and a are non-anticipating; that is, (u, o) G It x 21. Let us write 
[Z v ,P") for [Z^ Zn , Pt^pJ) to alleviate the notation. Since ^ < x* < the continuity 
of the paths of Z v <m& P" and (j3"T7j) lead to 

<p (r", Z»{t v \ P v {t v )) < <p {r\ Z v {r v \ P v {r v )) - r,. 

On the other hand, in view of (|3.15[) and (|3.16|) . Ito's formula applied to dp on 
yields that 

(p{T V ,Z V {T V ),P V {T»))<g>{t n ,Z n ,p n ). 

Therefore, the previous inequality and (|3.18[) show that 

tp{T v ,Z v (T v ),P v (T v ))<<p(t n ,z n ,p n )-r)<l-r]/2. 

By (GDP2 X ) of Lemma 13.31 we deduce that x(f n , z n ,p n — e n ) = 0, which contra- 
dicts dnmj). □ 



To complete the proof of the theorem, we still need to show Lemma 13.51 To this 
end, we first make the following observation. 

Lemma 3.6. Let a 6 Lf oc (W) be such that M = J adW is a bounded martingale and 
let /3 be an M. d -valued, progressively measurable process such that \/3\ < c(l + \a\) for 
some constant c. Then the stochastic exponential £ (j (3 dW) is a true martingale. 

Proof. The assumption clearly implies that J Q T \(3 S \ 2 ds < oo P-a.s. Since M is bounded, 
we have in particular that M E BMO; i.e., 



sup 

tSTo 



E 



la J 2 ds \F T 



< oo. 



In view of the assumption, the same holds with a replaced by /3, so that J ft dW is in 
BMO. This implies that £{J /3dW) is a true martingale; cf. O Theorem 2.3]. □ 

Proof of Lemma \3.5\ Consider the process 

Mr) := I ^%S„(r)l^(r); 
l Zj nV r VI 

we show that 

\Pn\ <c(l + \a n ' v '\) on[i„,r n ] (3.19) 

for some c > 0. Then, the result will follow by applying Lemma I3"l)l to a n ' Vo lu ntTn ]\ 
note that the stochastic integral of this process is bounded by the definition of t„ . To 
prove (|3. 19|) . we distinguish two cases. 

Case 1: d p (p(t , z ,p ) =^ 0. Using that (i and a are continuous and that U and B £ are 
bounded, tracing the definitions yields that 

\6 n \ <c{l + \a n ' v °\ + \a n ' v °\ 2 \dppy(;Z n ,P n )\} on p„,r„], 
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while 

|E»| > -c+\a n ' v °\\dM;Z n ,P n )\ on [t n ,r„], 

for some c > 0. Since d p tp(t , z ,p ) ^ by assumption, d p tp is uniformly bounded away 
from zero on B e , after diminishing e > if necessary. Hence, recalling (|3.12[) , there is a 
cancelation between |<5 n | and |£ n | which allows us to conclude (|3.19l) . 

Case 2: d p ip{t , z ,p ) = 0. We first observe that 

5+ <c{l^\a n ^\)-c- 1 \a n ^\ 2 d pp ^{- 1 Z n 1 P n ) on [t n ,r n ] 

for some c > 0. Since 5~ and |E„| _1 are uniformly bounded on A n , it therefore suffices 
to show that d pp tp > on B £ . To see this, we note that (|3.6|) and the relaxation in the 
definition (|3.3[) of H* imply that there exists L > such that, for some v <G V and all 
small e > 0, 

-dMt 0l z 0lPo ) + F(e\u,a,v) < -7] for all (it, a) 6^(6'), (3.20) 

where 9' = (zo,po, Dip, A L ) and A L is the same matrix as D 2 <p(t , z ,p ) except that 
the entry d pp tp(t , z ,p ) is replaced by d pp Lp{t , z ,p ) — l. Going back to the definition 
of Af £ , we observe that A/" e (0 l ) does not depend on l and, which is the crucial part, the 
assumption that d p ip(t , z ,p ) = implies that Af £ (<d L ) is of the form N u x R d ; that 
is, the variable a is unconstrained. Now (|3.20[) and the last observation show that 

-(dpptp(t , z 0lPo ) - i)|a| 2 < c(l + \a\) 

for all a G R d , so we deduce that d pp <p(t , z ,p ) > i > 0. Thus, after diminishing e > 
if necessary, we have d pp ip > on B e as desired. This completes the proof. □ 

3.3 PDE in the monotone case 

We now specialize the setup of Section lOl to the case where the state process Z consists 
of a pair of processes (X, Y) with values in M d_1 x R and the loss function 

I : R^ 1 xl4l, (x, y) h4 i(x, y) 

is nondecrcasing in the scalar variable y. This setting, which was previously studied 
in [3] for the case without adverse control, will allow for a more explicit description of 
A which is particularly suitable for applications in mathematical finance. 

For (t, x, y) £ [0, T] x R^ 1 x R and (u, i/)e«xV, let Z?£ y = (X?£ , Y^ y ) be the 
strong solution of (|3.1[) with 

/ n ( Hx(x,u,v) \ / ax(x,u,v) \ 

u(x,y,u,v) , \ ] , a[x,y,u,v) := , \ ] , 

where [iy and ay take values in R and R lxd , respectively. The assumptions from 
Section 13.11 remain in force; in particular, the continuity and growth assumptions on \i 
and a . In this setup, we can consider the real- valued function 

j(t,x,p) := in£{y e R : (x,y,p) £ A(t)}. 

In mathematical finance, this may describe the minimal capital y such that the given 
target can be reached by trading in the securities market modeled by X t an illustra- 
tion is given in the subsequent section. In the present context, Corollary 12.31 reads as 
follows. 
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Lemma 3.7. Fix (t,x,y,p) G [0,T] x R^ 1 xExl, let O C [0,T] x E d_1 xRxlte 
a bounded open set containing (t,x,y,p) and assume that 7 is locally bounded. 

(GDP1 7 ) Assume that y > 7(i, x,p + e) for some e > 0. TTien i/iere exist u G it and 
{a v , v G V} C A such that 



Xv(^) > 7* (r, X&"(t"), < (r")) P-a.«. /or aH „ G V, 



where r" is the first exit time of (■, X t '^, Y t Pf* p ) /rom O. 

(GDP2 7 ) Let ip be a continuous function such that ip > 7 and fei (u, o) G il x 21 and 
n > be such that 

Y t %(rn > if (t v ,X%(t v ), P$ ] (t»)) + r, P-a.s. for all v G V, 

where t" is the first exit time of ( ■, X^ , Yt,x, y i Pt}p^ ) from O. Then y > 7(i,x,p — e) 
for all e > 0. 

Proof. Noting that y > "/(t, x,p) implies (x, y,p) G A(i) and that (x, y,p) G A(t) implies 
V > li^iX^), the result follows from Corollary [23] by arguments similar to the proof of 
Lemma I3"U1 □ 

The Hamiltonians G* and G* for the PDE describing 7 are defined like H* and H* 
in ([53)1 and ([331, but with 

F(<d,u,a,v) := j^y (x, j/, it, u) - M(x,P) (a;, ") T g - ^Tr o-( Xi p)0-J X pj(x,u,a,v)A 

where 9 := (x, y, q, A) G M^" 1 x R x R d x § d and 

/ \ ( Hx(x,u,v) \ ( o- x (x,u,v) \ 

^{x,P){x,u,a,v) := I Q I, cr (x ,p)(a:,u,a,u) := I ^ I, 

with the relaxed kernel Af E replaced by 

IC e (x,y,q,v) := {(u,a) G U x R d : |oy (x, y, w, i>) - g T o-( X ,p) (x, -a, a, v)\ < e} , 

and N^ip replaced by a set Kn p , defined like Nn p but in terms of /Co instead of Nq. 
We then have the following result for the semicontinuous envelopes 7* and 7* of 7. 

Theorem 3.8. Assume that 7 is locally bounded. Then 7, is a viscosity supersolution 
on [0,T) x R d_1 x R 0/ 

(-df + G>>0 
and 7* is a viscosity subsolution on [0,T) x R d_1 x R 0/ 

Proof. The result follows from Lemma [3.71 by adapting the proof of [3[ Theorem 2.1], 
using the arguments from the proof of Theorem 13.41 to account for the game-theoretic 
setting and the relaxed formulation of the GDP. We therefore omit the details. □ 

We shall not discuss in this generality the boundary conditions as t — > T; they are 
somewhat complicated to state but can be deduced similarly as in [3J. Obtaining a 
comparison theorem at the present level of generality seems difficult, mainly due to 
the presence of the sets K. e and Kn p (which depend on the solution itself) and the 
discontinuity of the nonlinearities at d p ip = 0. It seems more appropriate to treat this 
question on a case-by-case basis. In fact, once G* = G* (see also Remark 13. 9p . the 
challenges in proving comparison are similar as in the case without adverse player. For 
that case, comparison results have been obtained, e.g., in [5] for a specific setting (see 
also the references therein for more examples). 
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Remark 3.9. Let us discuss briefly the question whether G* = G*. We shall focus on 
the case where U is convex and the (nondecreasing) function 7 is strictly increasing with 
respect to p; in this case, we are interested only in test functions ip with d p tp > 0. Under 
this condition, (u,a) G ]C £ (-,p, (d x ip, d p ip), v) if and only if there exists £ with |£| < 1 
such that a = (dpip)" 1 (oyG, <P, u, v) — d x (p ax(-, u, v) — e£\ . From this, it is not hard 
to see that for such functions, the relaxation e \ 0, 0' — >• in (|3.3[) is superfluous as 
the operator is already continuous, so we are left with the question whether 

inf sup F(Q,u,a,v) = sup inf F(Q,u(Q,v),a(Q,v),v). 

The inequality ">" is clear. The converse inequality will hold if, say, for each e > 0, 
there exists a locally Lipschitz mapping (u £ ,a e ) G K^ p such that 

F(-, (u e , a e )(-, v), v) > sup F(-, u, a, v) — e for all v G V. 

(u,a)£Ko(- -v) 

Conditions for the existence of e-optimal continuous selectors can be found in [15L The- 
orem 3.2]. If (u £ ,a e ) is an £-optimal continuous selector, the definition of /Co entails 
that aJ(Q,v)q p = —a^ c (x,u e (<d,v),v)q x + aY(x,y,u £ (Q,v),v), where we use the no- 
tation 6 = (x, y,p, (qj , q p ) T , A). Then u e can be further approximated, uniformly 
on compact sets, by a locally Lipschitz function u s . We may restrict our attention 
to q p > 0; so that, if we assume that a T is (jointly) locally Lipschitz, the map- 
ping aJ(Q,v) := (qp)" 1 (-a] c (x,u e (Q,v),v)q x + a Y (x,y,u s (Q,v),v)) is locally Lips- 
chitz and then (u £ ,a £ ) defines a sufficiently good, locally Lipschitz continuous selector: 
for all v G V, 

F(;(u s ,a s )(-,v),v) > F(-,(u e ,a s )(;v),v)-O s {l) > sup F(-,u,a,v)-e-O s {l) 

on a neighborhood of O, where O e (l) —> as e — > 0. One can similarly discuss other 
cases; e.g, when 7 is strictly concave (instead of increasing) with respect to p and 
the mapping (x, y, q x , u, v) 1— > — <r~x(x, u, v)q x + o~y{x, y, u, v) is invcrtiblc in u, with an 
inverse that is locally Lipschitz, uniformly in v. 



4 Application to hedging under uncertainty 

In this section, we illustrate our general results in a concrete example, and use the 
opportunity to show how to extend them to a case with unbounded strategics. To this 
end, we shall consider a problem of partial hedging under Knightian uncertainty. More 
precisely, the uncertainty concerns the drift and volatility coefficients of the risky asset 
and we aim at controlling a function of the hedging error; the corresponding worst-case 
analysis is equivalent to a game where the adverse player chooses the coefficients. This 
problem is related to the G-expectation of [221 US] , the second order target problem 
of [23] and the problem of optimal arbitrage studied in [TU]. We let 

V = [f^JZ] x [a, a] 

be the possible values of the coefficients, where /j, < < ~p and a > a > 0. Moreover, 
U = M will be the possible values for the investment policy, so that, in contrast to the 
previous sections, U is not bounded. 

The notation is the same as in the previous section, except for an intcgrability con- 
dition for the strategies that will be introduced below to account for the unboundedness 
of U, moreover, we shall sometimes write v = (/i, a) for an adverse control v G V. Given 
(/i, a) G V and u G il, the state process Zt,x, y = (^tx)^Ty') * s governed by 

d x tx{ r ) 

V J -, \ = (J-r dr + a r dW r , X t<x (t)=x 
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and 

dY^(r) = U[v]r(n r dr + a r dW r ), Y^ (t) = y. 

To wit, the process X" x represents the price of a risky asset with unknown drift and 
volatility coefficients (fi,cr), while Y" y " stands for the wealth process associated to an 
investment policy u[is], denominated in monetary amounts. (The interest rate is zero 
for simplicity.) We remark that it is clearly necessary to use strategics in this setup: 
even a simple stop-loss investment policy cannot be implemented as a control. 
Our loss function is of the form 

£(x,y) = V(y-g(x)), 

where : R — > R are continuous functions of polynomial growth. The function is 
also assumed to be strictly increasing and concave, with an inverse \I f_1 : R —> R that 
is again of polynomial growth. As a consequence, t is continuous and (|2.3[) is satisfied 
for some q > 0; that is, 

\£(z)\ <C(1 + |*|«), z = (x,y)£R 2 . (4.1) 

We interpret g(X" X (T)) as the random payoff of a European option written on the risky 
asset, for a given realization of the drift and volatility processes, while ^ quantifies the 
disutility of the hedging error Y^ y v {T) — g{X" x (T)). In this setup, 

~/(t,x,p) = inf {y £ K : 3u £ it s.t. E [V(Y t U y (T) - g{X^ x {T))\T t ] >p P-a.s. Vz> £ V) 

is the minimal price for the option allowing to find a hedging policy such that the 
expected disutility of the hedging error is controlled by p. 

We fix a finite constant q > q V 2 and define it to be the set of mappings u : V — > U 
that are non-anticipating (as in Section [3]) and satisfy the integrability condition 









1 - 
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sup E 




[ \u[v] r \ 2 dr 
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The conclusions below do not depend on the choice of q. The main result of this section 
is an explicit expression for the price j(t,x,p). 

Theorem 4.1. Let (t,x,p) £ [0,T] x (0,oo) x R. Then j(t,x,p) is finite and given by 
j(t,x,p) = sup E [g {Xl x (T))\ + where V° = £ V : ft = 0}. (4.3) 

In particular, j(t,x,p) coincides with the superhedging price for the shifted option 
g(-) + '$>~ 1 (p) in the (driftless) uncertain volatility model for [a, ef]; see also below. That 
is, the drift uncertainty has no impact on the price, provided that fx < < JZ. Let us 
remark, in this respect, that the present setup corresponds to an investor who knows the 
present and historical drift and volatility of the underlying. It may also be interesting to 
study the case where only the trajectories of the underlying (and therefore the volatility, 
but not necessarily the drift) are observed. This, however, does not correspond to the 
type of game studied in this paper. 

4.1 Proof of Theorem 14.11 

Proof of ">" in (|4.3[) . We may assume that 7(t,x,p) < oo. Let y > j(t,x,p); then 
there exists u £ it such that 

E [* {Y*?(T) - g (*L(T)))] > p for all v £ V. 
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As ^ is concave, it follows by Jensen's inequality that 

* (E [Y»> V (T) ~ g fe(T))]) > p for all v G V. 

Since the integrability condition (|4.2[) implies that Yty is a martingale for all v e V°, 
we conclude that 

* (y - E [ fl (^(T))]) > p for all ,eV° 

and hence y > sup^gyo E [g (X£ X (T))] + v E' _1 (p). As y > -f(t,x,p) was arbitrary, the 
claim follows. □ 

We shall use Theorem 13.81 to derive the missing inequality in (|4.3[) . Since U = R is 
unbounded, we introduce a sequence of approximating problems "f n defined like 7, but 
with strategies bounded by n: 

7n(t, x,p) := inf {y e R : 3u G it n s.t. E [£ (Z t u ^(T)) |J" t ] > p P-a.s. 6 V} , 

where 

U™ = {u G 11 : \u[v]\ < n for all v G V}. 
Then clearly 7„ is decreasing in n and 

In > 7, " > 1- (4-4) 
Lemma 4.2. Lei (t, z) G [0, T] x (0, 00) x R, u G it, ana! define u„ G it by 

Un[v] := u[l/]l{| uM |<„ }) f G V. 

TTien 

ess sup |E (^'"(T)) - £ (Z?'Z(T)) \F t ] I -> in L 1 as n ^ 00. 

i/€V 

Proof. Using monotone convergence and an argument as in the proof of Step 1 in Sec- 
tion [231 wc obtain that 

E(esssup|E[^r(T)) -i{Z^{T)) \) = su P E {\t [Z^ (T)) - £ {Z^{T)) |} 



Since V is bounded, the Burkholder-Davis-Gundy inequalities show that there is a 
universal constant c > such that 



E{\Z?; Z <"(T)-Z? : :(T)\} < cE 



cE 



|«Mrl{|u[i/] r |>n}| dr 



and hence (|4.2[) and Holder's inequality yield that, for any given 5 > 0, 

supP{|^r(T)-^;(T)| >5} <5- l S upE{\Zir(T)-Z? : :(T)\}^0 (4.5) 



for n — > 00. Similarly, the Burkholder-Davis-Gundy inequalities and (|4.2I) show that 
{|^'"(T)| + \Z"^(T)\, v G V,n > 1} is bounded in This yields, on the one hand, 
that 

sup f{\Z^/{T)\ + \Z^{T)\>k}^Q (4.6) 

i/£V, n>l 
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for k — > oo, and on the other hand, in view of (|4.1[) and q > q, that 

{£ (Z%'"(T)) - e (Z^(T)) : v e V, n > l} is uniformly intcgrable. (4.7) 
Let e > 0; then (|4.6[) and (|4.7[) show that we can choose k > such that 



supE 
vev 



\t {Z^{T)) - £ (Z^(T)) | l {|z; ,„„ (T)|+|z;i ,, (T)|>fc} 



< £ 



for all n. Using also that £ is uniformly continuous on {|z| < k}, we thus find 5 > 
such that 

su P E[\£(Zl\r(T))-e(Zi:(T))\] 



<2e + sup 1 

v£V 



\t {ziy(T)) - i {z? : :{t)) I i {lz:r(T) _ zl , :iT)>s} 



By (|4.5[) and (|4.7[) . the suprcmum on the right-hand side tends to zero as n — > oo. This 
completes the proof of Lemma 14.21 □ 



Proof of "< " in (|4.3[) . It follows from the polynomial growth of g and the boundcdncss 
of V that the right-hand side of (|4.3p is finite. Thus, the already established inequality 
">" in (|4.3[) yields that j(t, x,p) > —oo. We now show the theorem under the hypoth- 
esis that j(t, x, p) < oo for all p; we shall argue at the end of the proof that this is 
automatically satisfied. 

Step 1: Let 7oo := inf„7„. Then the upper semicontinuous envelopes of 7 and 7^ 
coincide: 7* = 7^. 

It follows from (|4.40 that 7^ > 7*. Let 77 > and y > j(t,x,p + 77). We show that 
y > ln{t,x,p) for n large; this will imply the remaining inequality 7^ < 7*. Indeed, 
the definition of 7 and Lemma I4T21 imply that we can find u e it and u„ 6 it™ such that 

J(t,x,y,U n ) > J(t,x,y,u) -e n >p + r]- e„ P-a.s., 

where e„ — > in L 1 . If K n is defined like K, but with it™ instead of it, then it follows that 
K n (t, x,y) > p + 77 — e n P-a.s. Recalling that K n is deterministic (cf. Proposition 13. 
we may replace e„ by E[e„] in this inequality. Sending n — > 00, we then see that 
linin^oo K n (t,x,y) > p + r), and therefore K n (t,x,y) > p + r//2 for n large enough. 
The fact that y > 7„(t, x,p) for n large then follows from the same considerations as in 
Lemma [ 



Step 2: The relaxed semi-limit 



t£>(M,p) ■= limsup j*(t',x',p') 



n—too 
(*' ,p')-¥(t,x,p) 



is a viscosity subsolution on [0, T) x (0, 00) x R of 

-d t <p+ inf j-^Vd^i <0 (4.8) 

and satisfies the boundary condition 7^o(T, < 9(0;) + \& (p). 

We first show that the boundary condition is satisfied. Fix (x,p) £ (0, 00) x R 
and let y > g(x) + iff (p); then i{x,y) > p. Let (t n ,x n ,p n ) — > (T,x,p) be such that 
) lto{Ti x iP)- We consider the strategy u = and use the arguments 
from the proof of Proposition 13 . 1 1 to find a constant c independent of n such that 



ess sup E 
vev 



(T)-(x,y)|«|^ t „] <c(\T-t n \i + \x-x n \^j 



2G 



Similarly as in the proof of Lemma 14.21 this implies that there exist constants e„ — > 
such that 

J(t 0) > l(x, y) - £ n P-a.s. 

In view of £(x,y) > p, this shows that y > r y n (fniX n ,p n ) for n large enough, and hence 
that y > 7^(r,x,p). As a result, we have ^(T,x,p) < g(x) + x S^ 1 (p). 

It remains to show the subsolution property. Let ip be a smooth function and let 
(t a , x ,p ) £ [0, T) x (0, oo) x R be such that 

(ito " <P)(ta,x ,p ) = max(7^ -</?) = 0. 

After passing to a subsequence, [TJ Lemma 4.2] yields (t n ,x n ,p n ) — > (t ,x ,p ) such 
that 

lim (in ~ <P)(tn,X n ,Pn) = (ito ~ <P)(to,Xo,Po), 

and such that (t n ,x n ,p n ) is a local maximizer of (7* — tp). Applying Theorem 13.81 to 
7*, we deduce that 

sup inf Gip(; (u,a)(fjt,o), (fi,<r))(t n ,x n ,p n ) < 0, (4.9) 

(u,a)£K2 ip (-,D v ) (Miff)eV 

where 

GV(-, (u, a), (/U, c)) := u^i - d t <£ - [ixd x p - - (a 2 x 2 d xx p + a 2 d pp <p + 2<jxad xp p) 

and K2ip('> Dip)(t n ,x n ,p n ) is the set of locally Lipschitz mappings (u, a) with values in 
[—n, n] x R such that 

cru(x, q x ,q p , p., a) = xaq x + q p a(x, q Xl q p , p, a) for all a g [a, a] 

for all (x, (q x ,q P )) in a neighborhood of (x„, Dy>(f )). Since the mapping 

(0,oo) x M 2 x [/£,/!] x [a, 5=] -4 K 2 , (x,q x ,q p ,p,a) H- (xq x ,0) 

belongs to K2 ip (-, Dtp)(t n , x n ,p n ) for n large enough, f)4.9[) leads to 

-d t <p+ inf { -^a^a^l (t n ,x n ,p n ) < 

a£[a,?f] [ 2 J 

for n large. Here the nonlincarity is continuous; therefore, sending n —> 00 yields (|4.8[) . 

Step 5: We /iawe 7^ < it on [0, T] x (0, 00) x R, where 

ir(t,x,p) := sup E [g (X? (T))] + ^(p) 
uev° 

is the right hand side of (|4.3p . 

Indeed, our assumptions on g and \E' -1 imply that ir is continuous with polynomial 
growth. It then follows by standard arguments that tt is a viscosity supersolution on 
[0,T) x (0,oo) x R of 

-d t p+ inf (--(tVQkbpI >0, 

and clearly the boundary condition tt(T,x,p) > 5(2;) + v I'~ 1 (p) is satisfied. The claim 
then follows from Step 2 by comparison. 
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We can now deduce the theorem: We have 7 < 7* by the definition of 7* and 
7* = 7^ by Step 1. As 7^ < 7^ by construction, Step 3 yields the result. 

It remains to show that 7 < 00. Indeed, this is clearly satisfied when g is bounded 
from above. For the general case, we consider g m = gAm and let "f m be the correspond- 
ing value function. Given 77 > 0, we have 7 m (i,a;,p + 77) < 00 for all m and so (|4.3p 
holds for g m . We see from (|4.3[) that y := 1 + sup m J m (t, x,p + rf) is finite. Thus, there 
exist u m S il such that 

E [tf (y f u ^(T) - g m (X£ X (T))) \F t ] > p + r, for all v 6 V. 

Using once more the boundedness of V, we see that for m large enough, 

E [* {Yty ,v {T) - g (Xl x (T))) \F t ] > p for all v e V, 

which shows that "f(t,x, p) <y< 00. □ 

Remark 4.3. We sketch a probabilistic proof for the inequality "<" in Theorcm l4.11 for 
the special case without drift (/1 = /I = 0) and a > 0. We focus on t = and recall that 
yo := sup^gyo E[(?(A"q x (T))J is the supcrhedging price for g(-) in the uncertain volatility 
model. More precisely, if B is the coordinate-mapping process on SI = C([0,T];M), 
there exists an F B -progressively measurable process 7? such that 

Vo + I ti S ^TT> 9{B T ) P"-a.s. for all v £ V°, 

JO B s 

where P v is the law of Xq x under P (see, e.g., [20]). Seeing ■& as an adapted functional 
of B, this implies that 

yo+ M*lx) J'm >g{Xl x {T)) P-a.s. for all v £ V°. 

Jo ^-0,2' l s J 

Since is non-anticipating with respect to we see that u\y\ s := $ s (Xq x ) defines a 
non-anticipating strategy such that, with y := yo + 



T 

uM. 







dXKJs) 

-^l>g(X»jT)) + ^( P y, 



that is, 



*K;(r)- 9 (i„yT)) > P 

holds even P-almost surely, rather than only in expectation, for all v e V°, and V° = V 
because of our assumption that fx = ~p = 0. In particular, we have the existence of an 
optimal strategy u. (We notice that, in this respect, it is important that our definition 
of strategies does not contain regularity assumptions on v h-j- u[v}.) 

Heuristically, the case with drift uncertainty (i.e., \i ^ Jl) can be reduced to the 
above by a Girsanov change of measure argument; e.g., if fi is deterministic, then we 
can take u[(/x, a)] := u[(0, cr M )], where er^w) := a(uj + J fitdt). However, for general 
/x, there are difficulties related to the fact that a Girsanov Brownian motion need not 
generate the original filtration (see, e.g., [9]), and we shall not enlarge on this. 
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